Nang et al. BMC Medical Research Methodology 201 1, 1 1 :141 
http://www.biomedcentral.eom/1 471 -2288/1 1 /1 41 



Medical Research Methodology 



RESEARCH ARTICLE Open Access 



Validity of the international physical activity 
questionnaire and the Singapore prospective 
study program physical activity questionnaire in a 
multiethnic urban Asian population 

Ei Ei Khaing Nang\ Susan Ayuko Gitau Ngunjiri\ Yi Wu\ Agus Salim\ E Shyong Tai^'^ Jeannette Lee^ and 
Rob M Van Dam^'^'^' 



Abstract 

Background: Physical activity patterns of a population remain nnostly assessed by the questionnaires. However, 
few physical activity questionnaires have been validated in Asian populations. We previously utilized a connbination 
of different questionnaires to assess leisure time, transportation, occupational and household physical activity in the 
Singapore Prospective Study Program (SP2). The International Physical Activity Questionnaire (IPAQ) has been 
developed for a similar purpose. In this study, we compared estimates from these two questionnaires with an 
objective measure of physical activity in a multi-ethnic Asian population. 

Methods: Physical activity was measured in 152 Chinese, Malay and Asian Indian adults using an accelerometer 
over five consecutive days, including a weekend. Participants completed both the physical activity questionnaire in 
SP2 (SP2PAQ) and IPAQ long form. 43subjects underwent a second set of measurements on average 6 months 
later to assess reproducibility of the questionnaires and the accelerometer measurements. Spearman correlations 
were used to evaluate validity and reproducibility and correlations for validity were corrected for within-person 
variation of accelerometer measurements. Agreement between the questionnaires and the accelerometer 
measurements was also evaluated using Bland Altman plots. 

Results: The corrected correlation with accelerometer estimates of energy expenditure from physical activity was 
better for the SP2PAQ (vigorous activity: r = 0.73; moderate activity: r = 0.27) than for the IPAQ (vigorous activity: r 
= 0.31; moderate activity: r = 0.15). For moderate activity, the corrected correlation between SP2PAQ and the 
accelerometer was higher for Chinese (r = 0.38) and Malays (r = 0.57) than for Indians (r = -0.09). Both 
questionnaires overestimated energy expenditure from physical activity to a greater extent at higher levels of 
physical activity than at lower levels of physical activity. The reproducibility for moderate activity (accelerometer: r 
= 0.68; IPAQ: r = 0.58; SP2PAQ: r = 0.55) and vigorous activity (accelerometer: 0.52; IPAQ: r = 0.38; SP2PAQ: r = 0.75) 
was moderate to high for all instruments. 

Conclusion: The agreement between IPAQ and accelerometer measurements of energy expenditure from physical 
activity was poor in our Asian study population. The SP2PAQ showed good validity and reproducibility for vigorous 
activity, but performed less well for moderate activity particularly in Indians. Further effort is needed to develop 
questionnaires that better capture moderate activity in Asian populations. 
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Background 

Globally, non communicable diseases (NCDs), consisting 
mainly of cardiovascular diseases, cancers, chronic 
respiratory diseases and diabetes make up to 60% of all 
deaths [1]. WHO projects that NCD deaths will increase 
by 17% over the next ten years with the highest absolute 
number of deaths occurring in Asia [1]. Physical inactiv- 
ity has been identified as a modifiable shared risk factor 
for NCDs [1]. Although the health benefits of physical 
activity in preventing cardiovascular diseases, type 2 dia- 
betes, several cancers, and even poor mental health has 
been well established, the level of physical activity has 
been declining in many countries [2]. This may be due 
to several factors including increased reduced occupa- 
tional and household activity due to mechanization and 
reduced transport activity due to replacement of walking 
and cycling by transport using -cars, trains and buses. 
Leisure time activity may have increased due to greater 
popularity of sports activities or decreased due to more 
time spend on TV, computer games and the internet. 
However in order to describe, monitor and possibly 
implement effective interventions for physical activity it 
is important to measure activity levels accurately and 
across multiple domains of physical activity (transporta- 
tion, leisure-time, occupational and household) within 
the population studied. 

There are different methods for assessing physical 
activity. These include criterion methods such as doubly 
labeled water, indirect calorimetry, and direct observa- 
tion; objective methods such as heart rate monitor, ped- 
ometer, accelerometer; and subjective methods 
including questionnaires and activity diaries [3-6]. How- 
ever, the instrument used in large scale epidemiological 
studies has generally been the questionnaire because of 
low cost, ease of administration and relative ease of cal- 
culating energy expenditure [7]. 

The International Physical Activity Questionnaire 
(IPAQ) was designed to provide a set of well-developed 
instruments that can be used internationally to obtain 
estimates of physical activity that can be compared 
across different populations [8]. In order to interpret the 
findings from these questionnaire-based studies, it is 
important that the questionnaire is validated against 
objective assessments in the population of interest. The 
IPAQ has been validated in multiple populations, but 
within Asia only the Japanese and Hong Kong Chinese 
population have been studied [8-10]. In addition, the 
Japanese validation study only evaluated total physical 
activity and not the ability of IPAQ to differentiate 
between moderate and vigorous activity [8]. The two 
validation studies conducted in Hong Kong Chinese 
reported inconsistent results [9,10]. Thus, we would like 
to assess the measurement properties of IPAQ 



separately for moderate and vigorous activity in Singa- 
pore, a developed urban multi-ethnic Asian country. 

Between 2003 and 2007 we conducted a population- 
based study, the Singapore Prospective Study Program 
(SP2) [11], which collected data on physical activity. The 
SP2 Physical Activity questionnaire (SP2PAQ) was 
adapted from several established questionnaires devel- 
oped in Western nations [12-14] to assess transporta- 
tion, occupation, leisure time and household activities. 
The ability of the SP2PAQ and the IPAQ, which 
assesses similar domains of physical activity, to assess 
physical activity in Asian populations has not been eval- 
uated. This is important because the validity of other 
physical activity questionnaires used in Asian population 
such as the questionnaire in the Shanghai physical activ- 
ity study had limited validity for moderate-to-vigorous 
intensity (spearman correlation of 0.17) [15]. 

The aim of this study was to assess the validity of 
IPAQ long form in a multi-ethnic population of Chi- 
nese, Malays, and Indians living in Singapore and com- 
pares it against the SP2PAQ using accelerometer 
measurements as the reference instrument. 

Methods 

Study population 

We studied 164 participants, aged above 21 years. These 
were mainly students and staff from local university and 
hospital. Ethics approval was obtained from the National 
University of Singapore Institutional Review Board (NUS 
IRB). Written informed consent was obtained from all 
participants. One participant withdrew from the study 
after 2 days. Hence, 163 participants completed the study. 

Procedures 

Anthropometric measurements were taken (height to 
the nearest 0.1 cm and weight to the nearest kg). Parti- 
cipants then completed one of the two evaluated ques- 
tionnaires (SP2PAQ or IPAQ) before the physical 
activity monitoring period. Physical activity was moni- 
tored using an Actical accelerometer for five consecutive 
days including 3 weekdays and 2 weekend days. Partici- 
pants were instructed to wear the accelerometer for all 
waking hours except during water-based activities. After 
completion of the five- day monitoring period, partici- 
pants returned the accelerometer and completed the 
remaining questionnaire. The first 120 participants 
answered IPAQ before the monitoring period and 
SP2PAQ immediately after the monitoring period. The 
order of the questionnaires was reversed for the last 43 
participants to evaluate whether the order of question- 
naire assessment may have affected the results. 

Of the 163 participants, 52 participants were re- 
recruited to test reproducibility of the questionnaires 
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and the accelerometer. The reproducibiUty of the accel- 
erometer was evaluated at the same time as the ques- 
tionnaires were administered using the same device in 
both periods. The mean interval between the two assess- 
ments was 175 days (SD = 64 days) with minimum 63 
days and maximum 308 days. 

Physical activity questionnaires 

The 8 versions of International physical activity ques- 
tionnaire (IPAQ) were developed by an International 
Consensus Group between 1997 and 1998. These were 
developed as an instrument for cross-national monitor- 
ing of physical activity with a recall period of 7 days. In 
2000, the reliability and validity of the questionnaires 
were evaluated in 12 countries and the result was pub- 
Ushed in 2003, which showed acceptable reliability and 
validity [8,16]. Since its development, it has been vali- 
dated in different populations and also widely used in 
research studies [10,17-19]. The self- administered IPAQ 
long form covers four domains of physical activity: job 
related activity; transportation activity; housework, 
house maintenance, and caring for family; and recrea- 
tion, sports, and leisure-time physical activity. For each 
domain, the time spent on moderate and vigorous activ- 
ity per day and the numbers of days per week were 
recorded. Walking time was asked in all domains except 
household activity. In addition, time spent sitting on 
weekday and weekend was also recorded. 

The physical activity questionnaire used in Singapore 
Prospective Study Program (SP2PAQ) is an interviewer- 
administered questionnaire with a recall period of the 
previous 3 months. As mentioned before it was adapted 
from several established questionnaires validated in 
other populations [12-14] and encompassed transporta- 
tion, occupation, leisure time and household activities. 

The questions on transportation activity were adapted 
from National Health Survey 2004 questionnaire [20] 
which asked about walking or cycling for transport for 
at least 10 minutes. The duration, frequency and the 
intensity of the activity (light, moderate, or vigorous) 
were recorded. Questions on occupational activity were 
based on the validated Modifiable Activity Question- 
naire [13,21]. Participants were asked to list all jobs held 
during the past 3 months. For each job entry, data was 
collected for the job schedule and job activity was deter- 
mined by the number of hours spent sitting at work and 
the most common physical activities performed when 
not sitting. Leisure time activity was adapted from the 
Minnesota leisure time activity questionnaire covering a 
total of 48 specific activities and open questions about 
possible other activities which has been validated in var- 
ious populations [14,22-24]. For each activity, partici- 
pants identified the frequency and the average duration 
of participation in each activity. Household activity was 



adapted from the Yale physical activity questionnaire 
which covers housework, yard work and caretaking for 
elderly persons or children and has been validated in 
diverse populations [12,25,26]. Participants were asked 
about the type of activity performed and the frequency 
and duration of each activity. The SP2PAQ can be 
found in additional file 1. 

Actical physical activity monitor 

Objective measurement of physical activity was obtained 
by using the Actical® physical activity monitor (Mini 
Mitter Co., Inc., Bend, OR) which is a water resistant, 
lightweight (17 g) and small (28 x 27 x 10 mm) device. 
The monitors are initialized and downloaded through 
the ActiReader PC serial port interface. According to 
manufacturer, the Actical is an omnidirectional, piezo- 
electric accelerometer, which is able to detect move- 
ments in all directions. It is sensitive to movements in 
the range of 0.5-3 Hz and its sensitivity allows for detec- 
tion of sedentary movement as well as high-energy 
movements. Its reduced frequency range also minimizes 
the effect of undesirable noise impulses, which tend to 
skew energy expenditure [27]. The Actical accelerometer 
has been validated previously showing good reliability 
and accuracy for estimating the energy expenditure 
from physical activity and the time spent in moderate 
and vigorous physical activity [28,29] and has been used 
in epidemiological studies [30]. The physical activity 
intensity prediction of the Actical accelerometer was 
validated with a room calorimeter. This showed that dif- 
ferences between the measurements of the Actical accel- 
erometer and the calorimeter for the time spent in each 
moderate and vigorous intensity activity was < 2% [31]. 

Compared to ankle and wrist, hip was the best loca- 
tion for monitor placement to predict the energy expen- 
diture from physical activity when validated against with 
VmaxST portable metabolic system (R = 0.90) [32]. For 
this study, all participants wore the Actical acceler- 
ometer on the right hip, just anterior to iliac crest with 
elastic belt. The device was initialized using 15-s epochs 
and converted to 1-min epochs for data analysis of 
energy expenditure. 

The quality of the devices was monitored by checking 
the coefficient of variation (CV) of the devices monthly 
[33]. All the devices were placed on the mechanical sha- 
ker for 12 hours and the CV was calculated by dividing 
the standard deviation of activity counts with the mean 
of activity counts captured by the devices. The CVs dur- 
ing the study period were acceptable, ranging from 
10.2% to 16.6%. 

Calculation of Energy Expenditure from Physical Activity 

For IPAQ, we used the IPAQ data processing rules [34] 
for our calculations. The data was truncated at 21 hours 
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per week for each of the following groups of activities: 
walking activity, other moderate activity, and vigorous 
[34]. Subsequently, walking activity and other moderate 
activity were combined to derive total moderate activity. 
Metabolic equivalent task (MET) levels were obtained 
from the IPAQ scoring protocol [34] for the IPAQ ques- 
tionnaire and from the compendium by Ainsworth et al 
[35] for the SP2PAQ questionnaire. One MET unit is 
defined as the energy expenditure for sitting quietly, 
which for the average adult is approximately 3.5 ml of 
oxygen x kg bodyweight'^ x min'^ or 1 kcal x kg body 
weight'^ X h'^ [35]. For both questionnaires, minutes 
were converted to hours and weekly energy expenditure 
from each physical activity (Kcal/week) was calculated 
as follows: hours spent on activity per day x numbers of 
days per week x MET value x body weight in kg 
[36,37]. Then the energy expenditures from all the activ- 
ities under each intensity category were combined to 
obtain the total energy expenditure per week for each 
moderate and vigorous intensity category. Moderate 
intensity was defined as 3 to 6 METs and vigorous 
intensity was defined as more than 6 METs [38] . 

The resulting measures from the two questionnaires 
expressed in Kcal per week were divided by 7 and the 
total Kcal for each moderate and vigorous intensity cate- 
gory from accelerometer for 5-day wearing period was 
divided by 5, to derive average Kcal per day for all 
methods. 

The Actical accelerometer recorded physical activity in 
a series of activity counts which were proportional to 
the magnitude and duration of the sensed accelerations. 
The raw minute-by-minute activity counts were then 
transformed into energy expenditure by the computer 
program using MET prediction algorithms of Klippel et 
al [32]. The output of the program included data of 
energy expenditure (Kcal/day) and time spent on light, 
moderate and vigorous activity with cutoff points of 3 
METs between light and moderate activity and 6 METs 
between moderate and vigorous activity. In this study, 
we used 2R regression to estimate energy expenditure 
from physical activity, which exhibits a decreased ten- 
dency to over predict energy expenditure [27]. 

Statistical Analysis 

The accelerometer data was considered valid only when 
10 or more hours of data per day were collected for five 
days. Thus, 8 participants were excluded because they 
did not meet this criterion. In addition, 3 participants 
who reported the sum total of all walking, moderate and 
vigorous time more than 16 hours per day in IPAQ 
were treated as outliers and excluded from analysis 
according to IPAQ data processing rule [34]. As a result, 
152 participants were included in the analysis and 43 
participants for reproducibility analysis. The correlations 



between estimates of energy expenditure from physical 
activity assessed by the accelerometer and estimates 
assessed by questionnaires were obtained by the Spear- 
man rank correlation test. Because correlations between 
the questionnaires and the reference instrument (i.e. the 
accelerometer) are interpreted as measures of the accu- 
racy of the questionnaires, it is desirable to correct for 
limitations of the reference instrument that reduce these 
correlations. Thus we calculated correlation coefficients 
corrected for within-person variation in the acceler- 
ometer measurements using the formula suggested by 
Beaton et al [39]. 

r A accelerometer 
^ naccelerometer 

where 

rt = "true" correlation coefficient 
ro = observed correlation coefficient 

1 — ICCaccelerometer 

A accelerometer = 

ICCaccelerometer 

where ICCaccelerometer = interclass correlation coeffi- 
cient of accelerometer 

^accelerometer = number of repeated accelerometer mea- 
surements within-subject 

The 95% and 99.99% confidence intervals for correc- 
tion correlations were calculated using the formulas sug- 
gested by Willett et al [40]. In addition, a Bland- Altman 
plot was created for the agreement between the ques- 
tionnaires and the accelerometer measurement. The 
reliability of the questionnaires was evaluated using 
Spearman rank correlation coefficients. All statistical 
analyses were performed using Stata 10 for Windows 
(Stata Corporation, College station, Texas, USA). 

Results 

The study population (N = 152) had mean age of 38.3 
years and mean BMI of 24.54 kg/m^. The majority of 
participants had a job, but there were also students, 
homemakers, retired and unemployed participants. 
Nearly 70% had a higher education while 21% achieved 
secondary education and less than 10% had no educa- 
tion or primary level. There was a large variation in 
household income among participants (Table 1). 

Additional file 2 shows the correlation between the 
IPAQ and SP2PAQ. The two questionnaires showed 
reasonable correlation with each other for moderate 
activity (r = 0.55), but a low correlation for vigorous 
activity (r = 0.27). Table 2 presents data on the Spear- 
man rank correlation between energy expenditure from 
physical activity assessed using questionnaires and the 
accelerometer. In general, correlations were higher for 
vigorous activity than moderate activity and higher for 
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Table 1 Socio-demographic characteristics of study 


population 




N = 152 


Age(years), mean ± SD 


38.30 ± 12.86 


Body Mass lndex(kg/in^), mean ± SD 


24.54 ± 4.64 


Age group (N, %) 




< 40 years 


87(57.24) 


> 40 years 


65(42.76) 


Gender (N, %) 




Male 


54(42.1 1) 


Female 


88(57.89) 


Ethnicity (N, %) 




Chinese 


66(43.42) 


Malay 


34(22.37) 


Indian 

1 1 \^ lull 


52(34.21) 


Highest level of education (N, %) 




None/primary 


13(8.55) 


Secondary 


32(21.05) 


Technical school/diploma 


42(27.63) 


University 


65(42.76) 


Work status (N, %) 




Working 


98(64.47) 


Student 


33(21.71) 


Homemaker 


17(11.18) 


Retired 


3(1.97) 


Unemployed 


1 (0.66) 


Household income(S$/month) (N, %) 




Less than $2000 


27(1 7.76) 


$2000 to $3999 


40(26.32) 


$4000 to $5999 


37(24.34) 


$6000 to $9999 


27(17.76) 


More than $ 10 000 


19(12.5) 


Decline to answer 


2(1.32) 



the SP2PAQ than for the IPAQ. The correlations 
between the IPAQ and accelerometer were 0.13 for 
moderate activity, 0.18 for vigorous activity, and 0.19 for 
moderate and vigorous activity combined. These corre- 
lations remained low after correction for within-person 
variation in the accelerometer measurements; the cor- 
rected correlation was 0.15 for moderate activity was 
and 0.31 for vigorous activity. The correlation for the 
SP2PAQ was 0.24 for moderate activity, 0.42 for vigor- 
ous activity, and 0.28 for moderate and vigorous activity 
combined. Correction of these correlation coefficients 
for within-person variation in the accelerometer mea- 
surements increased the correlation only slightly for 



moderate activity (r = 0.27), but substantially for vigor- 
ous activity (r = 0.73). No substantial difference in cor- 
relation between the questionnaires and accelerometer 
was observed according to the order of the question- 
naire assessments (i.e. before or after the accelerometer 
assessment) (data not shown). 

The validity of the questionnaires was further assessed 
by stratifying the study population according to age, 
gender, and ethnic group. Compared with the younger 
age group, the correlation between the energy expendi- 
ture from physical activity assessed by questionnaire and 
accelerometer in the older group tended to be higher 
for moderate activity, but lower for vigorous activity. 
This was observed for both questionnaires. The correla- 
tion was higher in men for both moderate and vigorous 
activity when the IPAQ was used, whereas the correla- 
tion was higher in women than men for moderate activ- 
ity when the SP2PAQ was used. 

The performance of the SP2PAQ was similar in all 
three ethnic groups for vigorous activity, but for moder- 
ate activity, Malays showed a higher correlation with 
accelerometer measurements than Chinese and particu- 
larly Indians. For the IPAQ, reasonable correlations 
were only observed with the accelerometer in Chinese 
for moderate activity and Indians for vigorous activity. 

The agreement between the questionnaires and the 
accelerometer was also evaluated using Bland-Altman 
plots. Both IPAQ and SP2PAQ underestimated average 
energy expenditure from moderate activity, but overesti- 
mated average energy expenditure from vigorous activity 
as compared with the accelerometer. The mean differ- 
ence of daily energy expenditure between the measure- 
ments of IPAQ and accelerometer for moderate activity 
was -169 Kcal/day (95%CI: -236 to -90) and that of 
between SP2PAQ and accelerometer was -196 Kcal/day 
(95% CI: -295 to -97). SP2PAQ showed good agreement 
with the accelerometer for moderate activity when the 
energy expenditure was below approximately 1200 Kcal 
per day. However, it tended to overestimate energy 
expenditure when energy expenditure increased above 
that level (Figure 1). For vigorous activity, the mean dif- 
ference of daily energy expenditure between the mea- 
surements of the IPAQ and accelerometer was 139 Kcal 
per day (95% CI: 82 to 196) and that of between 
SP2PAQ and accelerometer was 81 Kcal per day (95% 
CI: 47 to 116). For vigorous activity, both questionnaires 
showed good agreement with the accelerometer for 
energy expenditure below approximately 400 Kcal per 
day. However, the higher the energy expenditure above 
that level, the greater was the degree of overestimation 
of the questionnaires (Figure 2). 

The reproducibility of the two questionnaires and the 
accelerometer was also evaluated (Table 3). IPAQ had 
higher reproducibility for moderate activity, but lower 
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Table 2 Correlation between the IPAQ and SP2PAQ measurements and accelerometer measurements of energy 



expenditure from physical activity. 



N = 152 


Moderate activity 
Correlation 


Corrected Correlation¥ 


Vigorous activity 

Correlation Corrected Correlation¥ 


IPAQ 


0.13 


0.15 


0.1 8* 


0.31* 


Stratified by age group 










<40 years (N = 87) 


0.08 


0.09 


0.30* 


0.52* 


> 40 years (N = 65) 


0.21 


0.24 


-0.07 


-0.01 


Stratified by gender 










Male (N = 64) 


0.24 


0.27 


0.28* 


0.48 


Female (N = 88) 


0.12 


0.13 


0.05 


0.09 


Stratified by ethnicity 










Chinese (N = 66) 


0.32^ 


0.36* 


0.20 


0.35 


Malay (N = 34) 


0.19 


0.21 


0.07 


0.12 


Indian (N = 52) 


-0.15 


-0.17 


0.28* 


0.48 


SP2PAQ 


0.24* 


0.27* 


0.42** 


0.73* 


Stratified by age group 










<40 years (N = 87) 


0.21 


0.24* 


0.48** 


0.83 


> 40 years (N = 65) 


0.27* 


0.30* 


0.28* 


0.48 


Stratified by gender 










Male (N = 64) 


0.16 


0.18 


0.49** 


0.85 


Ferr^ale (N = 88) 


0.29* 


0.33* 


0.34* 


0.59* 


Stratified by ethnicity 










Chinese (N = 66) 


0.34* 


0.38* 


0.50** 


0.87 


Malay (N = 34) 


0.51* 


0.57 


0.39* 


0.68 


Indian (N = 52) 


-0.08 


-0.09 


0.32* 


0.55 



*p value < 0.05, p value < 0.0001 

IPAQ = International Physical Activity Questionnaire; SP2PAQ = Singapore Prospective Study Program Physical Activity Questionnaire 
¥ corrected correlation = corrected for within-person variation in accelerometer measurements. 
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Figure 1 Bland-Altman plot for comparing the agreement between questionnaires and accelerometer measurements of moderate 
activity. The difference of estimate of moderate physical activity from the questionnaire and the accelerometer (y-axis) are depicted in relation 
to the mean of estimates of moderate physical activity from the questionnaire and the accelerometer (x-axis). 
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Figure 2 Bland-Altman plot for comparing the agreement between questionnaires and accelerometer measurements of vigorous 
activity. The difference of estimate of vigorous physical activity from the questionnaire and the accelerometer (y-axis) are depicted in relation to 
the mean of estimates of vigorous physical activity from the questionnaire and the accelerometer (x-axis). 



reproducibility for vigorous activity than the SP2PAQ. 
The reproducibility of the accelerometer was higher 
than the two questionnaires for moderate activity, but 
lower than SP2PAQ for vigorous activity. 

Discussion 

In our study in a developed multi-ethnic urban Asian 
population, SP2PAQ showed a substantially higher cor- 
relation with an objective measure of energy expenditure 
from physical activity than the IPAQ for both moderate 
and vigorous activity. The validity of the IPAQ for rank- 
ing the physical activity level of individuals was inade- 
quate in our population, whereas the validity for 



SP2PAQ was acceptable for this purpose with the possi- 
ble exception of ranking moderate activity in Indians. 
Both questionnaires tended to overestimate energy 
expenditure for vigorous activity, especially at higher 
levels of energy expenditure. For moderate activity, both 
questionnaires underestimated the energy expenditure 
when compared with the measurement of accelerometer. 
The reproducibility over an average of 6 months of the 
two questionnaires and the accelerometer was reason- 
ably good. 

Our study showed that the corrected correlation for 
vigorous activity was substantially better than for mod- 
erate activity, and this is consistent with findings in 



Table 3 Reproducibility of IPAQ, SP2PAQ, and accelerometer measurements of energy expenditure from physical 
activity. 



N = 43 


IPAQ 


SP2 PAQ 


Accelerometer 




Moderate activity Vigorous activity 


Moderate activity Vigorous activity 


Moderate activity Vigorous activity 


Spearman correlation 


0.58** 0.38* 


0.55** 0.75** 


0.68** 0.52* 



*p value < 0.05, ** p value < 0.0001 

IPAQ = International Physical Activity Questionnaire; SP2PAQ = Singapore Prospective Study Program Physical Activity Questionnaire 
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other studies [41,42]. In the Stanford Five-City Project, a 
survey of a representative population sample of four 
cities in central California, which compared nine mea- 
surement instruments for physical activity, recall was 
accurate for vigorous activity, but poor for moderate 
activity and this finding was consistent in men and 
women and in all domains of activity [41]. The same 
finding was observed in the validation of the Stanford 7- 
Day Recall, which showed lower correlation for moder- 
ate activity than vigorous activity in men (0.23 vs. 0.59) 
[42]. 

The correlation between IPAQ and accelerometer in 
our population appears to be lower than other popula- 
tions [18,43]. In the New Zealand population the corre- 
lation was 0.19 for moderate activity and 0.42 for 
vigorous activity [43] and in a Swedish population it was 
0.21 for moderate activity and 0.71 for vigorous activity 
[18]. This may be due to differences in culture as well 
as educational level of participants that might affect 
interpretation of the questionnaire [8]. All participants 
in the Swedish study had a higher education level, 
whereas our study population consisted of participants 
with varying educational levels. However, when com- 
pared with other validation studies in Asia, the correla- 
tion between IPAQ and accelerometer for the Chinese 
ethnic group in our study was similar to the Chinese 
population studied in Hong Kong (r = 0.27 for moderate 
activity and r = 0.28 for vigorous activity) [10]. Another 
validation study in the Chinese population of Hong 
Kong showed different results according to the acceler- 
ometer used: the correlations of IPAQ with the Tritrac 
accelerometer were 0.15 and 0.18 for moderate and vig- 
orous activity respectively, whereas with the MTI accel- 
erometer these correlations were -0.06 and 0.44 
respectively. In a Japanese population, the correlation 
between the IPAQ and accelerometer measurements of 
total physical activity was 0.36 [8]. 

The validity of SP2PAQ is comparable to other ques- 
tionnaires that have been used in large epidemiological 
studies. For example the correlation of Behavioural Risk 
Factor Surveillance System (BRFSS) physical activity 
questionnaire used for monitoring physical activity 
across the U.S.A. compared with the accelerometer was 
0.31 for moderate activity and 0.17-0.26 for vigorous 
activity [44], whereas the correlation of New Zealand 
Physical Activity Questionnaire (NZPAQ-LF) with accel- 
erometer was 0.30 for moderate activity and 0.37 for 
vigorous activity [43]. 

When we compared questionnaire and accelerometer 
estimates of energy expenditure from physical activity 
using Bland-Altman plots, greater differences between 
the two methods were observed with increasing means 
of measurements for both moderate and vigorous activ- 
ity. This may be due to either the questionnaire 



increasingly over-estimating activity with increasing 
activity or the accelerometer increasingly under-estimat- 
ing activity with increasing activity. In a study done by 
Klesges et al reported that participants overestimated 
the duration of their physical activities, especially for 
aerobic activities [45]. In addition, the Actical acceler- 
ometer may have underestimated energy expenditure, 
especially at high levels of energy expenditure [46]. The 
accelerometer is known to substantially underestimate 
energy expenditure for specific activities [47]. For exam- 
ple, accelerometers have limitations in detecting activ- 
ities where the body is mostly stationary such as when 
cycling or weight lifting [47]. Moreover, in our study, 
the accelerometer was taken off during water-based 
activities. This may have reduced the amount of activity 
detected by the accelerometer as compared with the 
questionnaire although only five participants reported 
swimming during the period in which they wore the 
accelerometer. The combination of over-estimation by 
the questionnaires and under-estimation by the acceler- 
ometer may have given rise to the observation that the 
difference between these methods was greater at higher 
levels of activity. Similar findings were reported for a 
nationally representative sample of the Swedish popula- 
tion, where the difference between the IPAQ and accel- 
erometer measurements of time spent on physical 
activity was larger at higher activity levels reported by 
the IPAQ [48]. 

Several methodological differences exist between 
SP2PAQ and IPAQ. It should be noted that the IPAQ 
assesses physical activity in the past week, whereas the 
SP2PAQ assesses habitual physical activity of at least 
the past 3 months. For the first 120 participants, the 
week recorded by IPAQ was different from that of the 
week measured by the accelerometer as IPAQ was 
administered before the accelerometer wearing period. 
However, we reversed the order of questionnaire admin- 
istration for the subsequent 43 participants so that the 
IPAQ questionnaire applied to the same week of accel- 
erometer measurement and found that the order of 
questionnaire administration did not affect the agree- 
ment with accelerometer measurements. The mode of 
administration of the questionnaires was also different 
as SP2PAQ is administered by an interviewer whereas 
IPAQ is self-administered. In a comprehensive review of 
physical activity instruments, it was concluded that the 
accuracy of interviewer-administered questionnaires 
tends to be greater than for self-administered question- 
naires [49]. Finally it should be noted that the primary 
intention of IPAQ is to obtain comparable population 
estimates of physical activity data across different coun- 
tries, whereas the aim of SP2PAQ was to assess inter 
individual variation in usual physical activity within a 
population. 
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To our knowledge, this is one of a few studies that vaU- 
dated physical activity questionnaires in an Asian popula- 
tion. In addition, the correlations were corrected for 
within-person variation in the accelerometer measure- 
ments. Within-person correlation in the reference instru- 
ment will reduce the correlation with the evaluated 
questionnaires and should be corrected for in validation 
studies [50]. The drop-out rate in our study was negligi- 
ble as there was only one person who withdrew from the 
study. There are also several limitations in our study that 
need to be considered. The size of our study population 
was modest and most participants were from a hospital 
and a university campus thus limiting generalizability. 
However, the participants were derived from fairly wide 
age and socioeconomic groups with different educational, 
occupational and income levels. Although the distribu- 
tions of age, gender and ethnicity were not exactly the 
same across the sub-groups, these differences in distribu- 
tion were not statistically significant. The reference mea- 
surement used in this study was the accelerometer which 
is not the gold standard to validate the physical activity 
measurements [51]. However, the current reference stan- 
dard for validating activity questionnaires, the doubly 
labeled water technique, is not only very costly but it also 
does not provide information on the patterns of physical 
activity as it estimates total energy expenditure [51]. The 
accelerometer on the other hand can provide the fre- 
quency, duration and intensity of free living physical 
activity to obtain a good estimate of energy expenditure 
and has been recommended as an objective method of 
choice to use in validating questionnaires or studying 
patterns of physical activity [6,52,53]. It has also been 
used to validate physical activity questionnaires in 
national surveys such as the England Physical Activity 
questionnaire [54] and the BRFSS [44]. Finally, the inter- 
val between the test and retest measurements was rather 
long. We realize that as a result the reliability estimates 
are affected by both measurement error related to the 
assessment of short-term activity and real changes in 
activity habits of participants over time. However, in epi- 
demiological studies we are generally interested in habi- 
tual activity over years as this is most relevant for the 
development of chronic diseases. For this application, an 
inability of assessment methods to capture long-term 
physical activity is therefore a limitation and long-term 
reproducibility, part of which may be due to real changes 
in physical activity, is most relevant. 

Conclusion 

Our study showed that the IPAQ had limited accuracy 
for distinguishing physical activity levels of individuals 
and performed poorly in our study population as com- 
pared with Western populations. However, its perfor- 
mance was comparable to that observed in a Chinese 



population in Hong Kong. The SP2PAQ had acceptable 
validity and reproducibility and can be used in large epi- 
demiological studies particularly for the assessment of 
vigorous physical activity. For moderate activity, how- 
ever, adaptation of the questionnaire for the Indian 
population may be needed. For both the IPAQ and 
SP2PAQ questionnaire, considerable measurement error 
observed for the estimation of absolute physical activity 
levels particularly at higher levels of activity, which 
should be taken into account when the adequacy of 
activity levels of population groups are assessed. When 
we compare our results for IPAQ with results from stu- 
dies in other populations, it is evident that the validity 
of the IPAQ differs substantially between populations. 
Thus, validation sub-studies using objective measures of 
physical activity within large epidemiological studies are 
desirable to quantify measurement error and later cor- 
rect estimates of physical activity and health outcomes 
for measurement error. 

Additional material 



Additional file 1: "Singapore Prospective Study Program Physical 
Activity Questionnaire (SP2PAQ)" for the questionnaire used to 
assess physical activity in Singapore Prospective Study Program. 

Additional file 2: "Correlation between IPAQ and SP2PAQ 
measurements of energy expenditure from physical activity" for 
spearman correlations between IPAQ and SP2PAQ measurements 
of energy expenditure from moderate and vigorous activity. 
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